Events

Result1,305 events

Robot Shop (EKS) and discount erroneous call rate high

Robot Shop (EKS) and MySQL@3306 on workload-driver-managed-demo erroneous call rate high

Robot Shop (EKS) Calls are slower for shipping which is critical

QOTD calls slower than normal

QOTD calls slower than normal

QOTD High Erroneous Call Rate

QOTD High Erroneous Call Rate

QOTD High Erroneous Call Rate

QOTD overall application performance is slow

Robot Shop (EKS) Calls are slower for MySQL@3306 on workload-driver-managed-demo which is critical

Robot Shop (EKS) Calls are slower for nginx-web which is critical

Robot Shop (EKS) Calls are slower for shipping which is warning

Robot Shop (EKS) Calls are slower for discount which is critical

Robot Shop (EKS) and MySQL@3306 on workload-driver-managed-demo erroneous call rate high

Robot Shop (EKS) and discount erroneous call rate high

QOTD High Erroneous Call Rate

Robot Shop (EKS) Calls are slower for shipping which is warning

Robot Shop (EKS) and MySQL@3306 on workload-driver-managed-demo erroneous call rate high

Robot Shop (EKS) and discount erroneous call rate high

QOTD calls slower than normal

QOTD calls slower than normal

QOTD calls slower than normal

QOTD High Erroneous Call Rate

QOTD High Erroneous Call Rate

QOTD High Erroneous Call Rate

Robot Shop (EKS) Calls are slower for discount which is critical

Robot Shop (EKS) Calls are slower for nginx-web which is critical

Robot Shop (EKS) Calls are slower for MySQL@3306 on workload-driver-managed-demo which is critical

Robot Shop (EKS) and MySQL@3306 on workload-driver-managed-demo erroneous call rate high

Robot Shop (EKS) and discount erroneous call rate high

Robot Shop (EKS) and MySQL@3306 on workload-driver-managed-demo erroneous call rate high

Summary

Triggered

Jul 8, 202511:32:02 AM

Ended

Jul 8, 202511:51:37 AM

Duration

19m 35s

Severity

Critical

Affected entities

2

Incident overview

Triggering event

Description:

The erroneous call rate is higher or equal to 100%.

  • 2025-07-08, 11:29:02
    11:31
    11:34
    11:36
    11:39
    11:41
    11:44
    11:46
    11:49
    Title
    On
    Started
    End
    Duration
    Abnormal termination
    /usr/sbin/mysqld
    2025-07-08 11:30:01 2025-07-08 11:33:01 3m
    Description

    Process exited as a result of an uncaught signal: SIGKILL

    No details available.
    offline
    /usr/sbin/mysqld
    2025-07-08 11:30:38
    Description

    Process on Host workload-driver-managed-demo.instana.io

    No details available.
    Sudden increase in the number of erroneous calls
    MySQL@3306 on workload-driver-managed-demo
    2025-07-08 11:30:45 10m
    Description

    This can be a sign of a problem on one side of the connection

    • Absolute change: 100%
    • Confidence: 95.00%
    No details available.
    • All Erroneous Call Rate
    100%
    Sudden increase in average latency
    MySQL@3306 on workload-driver-managed-demo
    2025-07-08 11:31:45 10m
    Description

    This can be a sign of a problem on this service or its downstream

    • Relative change in value: 118315%
    • Confidence: 95.00%
    No details available.
    • All Calls Latency 50th
    2,200ms
    Erroneous call rate is too high
    MySQL@3306 on workload-driver-managed-demo
    2025-07-08 11:33:00 5m
    Description

    Erroneous call rate stays at a high level for an extended period of time

    No details available.
    • All Erroneous Call Rate
    100%
    1–5 of 6 items
    of 2 pages
Was this event helpful?

Probable root cause

Preview

Endpoint at fault:
CONNECT
As part of application perspective:
Robot Shop (EKS)

Probability level:

HIGH
Evidence:

100.00%

of aggregated calls going through the endpoint CONNECT are erroneous.

0.00%

of aggregated calls from the same entities that do not go through the endpoint CONNECT are erroneous.
Analyze calls
  • Diagnosis

    CONNECT endpoint’s 100% error rate is due to recurring connection pool timeouts, exhausting HikariCP-1’s capacity to provide connections within 2000ms.

    Error log summary

    The application is experiencing connection timeouts. The database connection pool (HikariPool-1) is unable to provide a connection within the specified timeout (2000ms), leading to requests being timed out. This issue is recurring, as evidenced by the second log entry.

    Trace log summary

    No further relevant information provided.

    Associated events summary

    The CONNECT endpoint is experiencing a persistently high error rate, with the V2LlbcNFJrXyd__rCaRtaqifoO4 metric being violated.

Was this suggestion helpful?
Context for:
    Instana uses algorithms and integrations to recommend actions for events.

    Recommended actions (6)

    Click to sort rows by Name header in ascending order
    Click to sort rows by Type header in ascending order
    Click to sort rows by Description header in ascending order
    Click to sort rows by Tags header in ascending order
    Click to unsort rows by Confidence header
    RecommendationEvent similarity
    Sample documentation link for Robot Shop documentation
    SAMPLE
    High
    RecommendationEvent similarity
    Remove messages from queue QOTD
    QOTD Quote Day
    High
    RecommendationEvent similarity
    Restart the MySQL Data
    mysqld
    abnormal
    +11
    High
    RecommendationNLP
    This resolves event: The erroneous call rate for Quote of the Day is higher or equal to 5%.
    watsonx
    High
    RecommendationNLP
    This resolves event: The erroneous call rate is higher or equal to 100%.
    ai
    High
    1–5 of 6 items
    of 2 pages

    Impacted business processes for triggering event

    Click to sort rows by Name header in descending order
    Version
    Click to sort rows by ID header in ascending order
    Click to sort rows by Started header in ascending order
    Click to sort rows by Activities header in ascending order
    Click to sort rows by Health header in ascending order

    No data available

    No data available